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The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

This application currently names joint inventors. In considering patentability of 
the claims under 35 U.S.C. 103(a), the examiner presumes that the subject matter of 
the various claims was commonly owned at the time any inventions covered therein 
were made absent any evidence to the contrary. Applicant is advised of the obligation 
under 37 CFR 1 .56 to point out the inventor and invention dates of each claim that was 
riot commonly owned at the time a later invention was made in order for the examiner to 
consider the applicability of 35 U.S.C. 103(c) and potential 35 U.S.C. 102(e), (f) or (g) 
prior art under 35 U.S.C. 103(a). 

Claims 1 , 4, 9, 1 5-1 9, 21 , 24-31 are rejected under 35 U.S.C. 1 03(a) as being 
unpatentable over NISHINO et al. (3D Object Modeling Using Spatial and Pictographic 
Gestures). 

As per claim 1, Nishino teaches the claimed "method of producing a shape, 
comprising: "using a virtual reality environment in which positions of a user's hand are 
tracked" (Nishino, page 55, column 1, lines 19-25); and "forming a three-dimensional 
modeled surface by adding shapes defined by hand movements" (Nishino, page 56, 
column 2, lines 3-9). It is noted that Nishino does not explicitly teach the shape adding 
operation is performed "at each of a plurality of intervals" as claimed. However, given 
Nishino sequential performance of shaping operations (e.g., page 54, figure 6-b), it 
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would have been obvious to perform the operations at each of a plurality of intervals 
because the order arrangement of operations in time intervals improves the realistic 
procedure of shaping an object and enhances the designing in a natural and intuitive 
manner. 

Applicant's arguments filed 10/21/2004 have been fully considered but they are 
not entirely persuasive. Examiner agrees Applicant's arguments on claims 2-3, 5 — 14, 
18, 20, 22-25, and 29-30, but disagrees on claims 1,4, 15-17, 19, 21, 26-28, and 31. 

Examiner disagrees Applicant's interpretation of the phrase "shape defined by 
hand movements." Nishino's hand shape and its position data used to create the object 
(page 55, column 1, lines 21-28) clearly satisfy the claimed "shape defined by hand 
movements." Applicant's arguments such as Nishino only chooses between a finite and 
limited number of shapes while the claimed system allows any shape to be defined 
which Examiner disagrees, but does not need to address because these features are 
not in the claim 1. 

Claim 4 adds into claim 1 "method as in claim 1 further comprising using 
an incremental technique to take an existing mesh of samples and changing it to add a 
new sample" which Nishino teaches in page 55, column 1, lines 39-41, with the deform 
and point postures to incrementally shape the object through its samples. 

Applicant argues that Nishino uses super quadric equations, and never 
teaches a mesh whatsoever which Examiner disagrees. In computer display arts, the 
objects are displayed as mesh in which the equations are used to describe the form of 
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the mesh. Nishino clearly teaches the mesh with the wire frame model (figure 13) to be 
mapped by texture (figure 3) or more specific, defining the object with a shape formed 
by polygons (page 56, column 2, lines 14-20). 

Claim 9 adds into claim 1 "defining a hand position which forms an eraser 
tool" which Nishino does not explicitly teach. However, given Nishino's gestures of 
natural and intuitive manipulations (page 56, column 1 , lines 18-34; e.g., by modifying 
(e.g., scale down) a part of the object, Nishino in effect erases a part of the existing 
shape), it would have been obvious because such claimed hand gestures provides the 
gesture based interface to improve the interface between the user and the system in a 
natural and intuitive manner and enhances the computer operations. 

Applicant argues that "Nishino does not erase parts of his shape. It is not known 
(even today) how to remove regions from shapes defined by superquadric equations. 
With polygonal meshes, it is well done and quite easy, ..." First, to completely erase a 
shape described by superquadric equation is simply just setting all the coefficients in the 
equation equal to zeroes. To partly erase a shape, just changing the coefficients; e.g., 
for erase a part of shape by scaling down, just modifying the coefficients by the scale 
ratio. The superquadric equations is well known in the art for describing the polygonal 
mesh form (see Nishono, page 56, column 2, lines 14-20). Given Nishino's gestures of 
natural and intuitive manipulations (page 56, column 1, lines 18-34), by modifying (e.g., 
scale down) a part of the object, Nishino in effect erases a part of the existing shape. 
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As per claim 15, Nishino teaches the claimed "method of producing a shape, 
comprising: "tracking a position of a user's hand" (Nishino, page 55, column 1, lines 19- 
25); and "forming a three-dimensional modeled surface by finding hand positions" 
(Nishino, page 56, column 2, lines 3-9), storing those positions (Nishino, figure 9, store, 
distributed buffer), and "forming the surface using said positions to define points on the 
actual surface that is formed" (Nishino, page 55, column 1, lines 31-33, the hand 
position using to move, scale and rotate the object defines points on actual formed 
surface). It is noted that Nishino does not explicitly teach the shape adding operation is 
performed "at different times" as claimed. However, given Nishino sequential 
performance of shaping operations (e.g., page 54, figure 6-b), it would have been 
obvious to perform the operations at different times because the order arrangement of 
operations in time intervals improves the realistic procedure of shaping an object and 
enhances the designing in a natural and intuitive manner. 

Applicant argues that Nishino does not teach "the hand position at 
different times is used to form actual points on the surface". Examiner does not think 
that this language makes clear distinction with the teaching of Nishino. Nishino's hand 
shape and its position data used to create the object (page 55, column 1, lines 21-28) 
clearly satisfy the claimed ""the hand position at different times is used to form actual 
points on the surface." 

Claim 16 adds into claim 15 "wherein said forming comprises using the hand to 
create 3d-strokes of shape" which Nishino teaches in page 55, column 1 , lines 37-41 . 
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Applicant argues that Nishino does not produce strokes. Nishono's hand 
movements in 3D space in process of forming the shape (figure 3, hand's movements 
illustrate the tapering, twisting) is equivalent to the claimed "using hand to create 3D 
strokes of shape." 

Claim 17 adds into claim 16 "said using comprises using the bend of the hand 
to define the curvature of 3d-strokes" which Nishino teaches in the deform posture 
(Nishino, page 55, column 1, lines 37-39, the user shapes the 3D object with the deform 
posture in which the curvature 3d surface of the object is a tangent to the hand). 

Applicant argues that Nishino does not produce 3D stroke curvature. 
Nishono's hand movements in 3D space in process of forming the curvature shape 
(figure 6, hand's movements illustrate the curvature bending) is equivalent to the 
claimed "using hand to create 3D stroke curvature." 

As per claim 18, Nishino teaches the claimed "method of producing a shape, 
comprising: "tracking a position of a user's hand" (Nishino, page 55, column 1, lines 19- 
25); and "forming a three-dimensional modeled surface based on said position of said 
user's hand" (Nishino, page 56, column 2, lines 3-9). It is noted that Nishino does not 
explicitly teach the shape adding operation is performed "at different times" as claimed. 
However, given Nishino sequential performance of shaping operations (e.g., page 54, 
figure 6-b), it would have been obvious to perform the operations at different times 
because the order arrangement of operations in time intervals improves the realistic 
procedure of shaping an object and enhances the designing in a natural and intuitive 
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manner. It is also noted that Nishino does not explicitly teach ""wherein said forming 
comprises using the hand to create 3dstrokes of shape; further comprising displaying a 
trace of the path of the hand, sensing at least 7 of the hand's degrees of freedom for the 
purposes of shape creation, said degrees of freedom including the hand's position and 
orientation in space, along with degrees of freedom that are affected by the hand's 
posture". However, given Nishino's gestures of natural and intuitive manipulations 
(page 56, column 1, lines 18-34, hand posture, hand position, hand orientation, ...), it 
would have been obvious because such claimed hand gestures provides the gesture 
based interface to improve the interface between the user and the system in a natural 
and intuitive manner and enhances the computer operations. 

Examiner disagrees Applicant's interpretation of the phrase "shape defined by 
hand movements." Nishino's hand shape and its position data used to create the object 
(page 55, column 1 , lines 21-28) clearly satisfy the claimed "shape defined by hand 
movements." 

As per claim 19, Nishino teaches the claimed "method of producing a shape, 
comprising: "tracking a position of a user's hand" (Nishino, page 55, column 1, lines 19- 
25); "forming a three-dimensional modeled surface based on said position of said 
user's hand" (Nishino, page 56, column 2, lines 3-9); "said forming comprises using the 
hand to create 3d-Strokes of shape" (Nishino, page 55, column 1, lines 37-39, the user 
shapes the 3D object with the deform posture in which the curvature 3d surface of the 
object is a tangent to the hand); "merging samples from one hand position to an existing 
shape" (Nishino, the user uses the blend posture to merge the primitive shape 
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represented by its samples to the existing shape). It is noted that Nishino does not 
explicitly teach the shape adding operation is performed "at each of a plurality of 
intervals" as claimed. However, given Nishino sequential performance of shaping 
operations (e.g., page 54, figure 6-b), it would have been obvious to perform the 
operations at each of a plurality of intervals because the order arrangement of 
operations in time intervals improves the realistic procedure of shaping an object and 
enhances the designing in a natural and intuitive manner. 

Applicant argues that Nishino does not teach "merging samples into an 
existing shape" which is not correct because of the teaching in blending the primitives in 
figures 3 (page 53), 5 (page 54) or 1 1 (page 57). 

Claims 21 adds into claim 15 "using hand postures to switch between different 
modes of operation" which Nishino does not explicitly teach. However, given Nishino's 
gestures of natural and intuitive manipulations (page 56, column 1, lines 18-34; 
example, hand posture for deform mode and hand posture for grasp mode), it would 
have been obvious to use hand gesture to switch operation modes because such 
claimed hand gestures provides the gesture based interface to improve the interface 
between the user and the system in a natural and intuitive manner and enhances the 
computer operations. 
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Claim 24 adds into claim 15 "displaying different tools at the hand's position 
based on different postures" which Nishino teaches in page 56, column 1, lines 18-34, 
figure 10-b for examples. 

Claims 25 adds into claim 15 "using the finger to draw a narrower stroke" which 
Nishino does not explicitly teach. However, given Nishino's gestures of natural and 
intuitive manipulations (page 56, column 1, lines 18-34), it would have been obvious to 
use figure to draw a narrow stroke because such claimed hand gestures provides the 
gesture based interface to improve the interface between the user and the system in a 
natural and intuitive manner and enhances the computer operations. 

As per claim 26, Nishino teaches the claimed "method of producing a shape, 
comprising: "a hand tracking element, which tracks three dimensional positions and 
hand shapes of an operator's hand in a virtual reality environment in which positions of 
a user's hand are tracked" (Nishino, page 55, column 1, lines 19-25); and "forming a 
three-dimensional modeled surface by adding shapes defined by hand movements" 
(Nishino, page 56, column 2, lines 3-9), It is noted that Nishino does not explicitly teach 
the shape adding operation is performed "at each of a plurality of intervals" as claimed. 
However, given Nishino sequential performance of shaping operations (e.g., page 54, 
figure 6-b), it would have been obvious to perform the operations at each of a plurality of 
intervals because the order arrangement of operations in time intervals improves the 
realistic procedure of shaping an object and enhances the designing in a natural and 
intuitive manner. 
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Applicant argues that Nishino does not teach "merging samples into an 
existing shape" which is not correct because of the teaching in blending the primitives in 
figures 3 (page 53), 5 (page 54) or 1 1 (page 57). 

As per claim 27, Nishino teaches the claimed "shape drawing system", 
comprising: "a user interface which operates to command shapes to be created" 
(Nishino, page 55, column 1, lines 19-25, page 56, column 2, lines 3-9). It is noted that 
Nishino does not explicitly teach "a processing element which incrementally adds 
surface regions to an extant surface" as claimed. However, given Nishino sequential 
performance of shaping operations (e.g., page 54, figure 6-b), it would have been 
obvious to perform the operations incrementally because the incremental arrangement 
of operations in time intervals improves the realistic procedure of shaping an object and 
enhances the designing in a natural and intuitive manner. 

Applicant argues that Nishino does not teach "merging samples into an 
existing shape" which is not correct because of the teaching in blending the primitives in 
figures 3 (page 53), 5 (page 54) or 1 1 (page 57). 

Claim 28 adds into claim 27 "wherein said user interface tracks hand movements" 
which Nishino teaches in page 55, column 1, lines 19-25. 

As per claim 29, Nishino teaches the claimed "method of drawing on a 
computer", comprising: "displaying a first shape on the computer" (Nishino, page 56, 



Application/Control Number: 09/496,137 Page 1 1 

Art Unit: 2673 

column 2, lines 3-9); "using the hand to define a new shape, to be added to said first 
shape" (Nishino, the primitive shapes). Applicant argues that Nishino does not teach 
"merging samples into an existing shape" which is not correct because of the teaching 
in blending the primitives in figures 3 (page 53), 5 (page 54) or 1 1 (page 57). 
It is noted that Nishino does not explicitly teach "using said new shape to apply 
deformations to said first shape and displaying said first shape as deformed by said new 
shape". However, given Nishino's deform and blend gestures, it would have been 
obvious to deform the existing shape when adding a new shape causing the first shape 
to change shape because such claimed hand-gesture operations provides the gesture 
based interface to improve the interface between the user and the system in a natural 
and intuitive manner and enhances the computer operations. 

Claim 30 adds into claim 29 ''wherein a portion of the first shape moves toward 
the hand" which Nishino teaches in the examples of 3D object modeling process of the 
teapot (figure 1 1-b) in which the shapes are blended, manipulated, and displayed. 

As per claim 31, Nishino teaches the claimed "system of 3d shape creation", 
comprising: "monitoring hand posture" (Nishino, page 55, column 1, lines 19-25). It is 
noted that Nishino does not explicitly teach "obtaining continuous variables that 
continuously vary between a maximum value and a minimum value based on said hand 
posture; and using said variables to define a shape" as claimed. However, Nishino's 
tracking of hand position which includes the bounded and continuous coordinate 
variables x, y, z suggests the claimed "continuous variables that continuously vary 
between a maximum value and a minimum value". It would have been obvious to use 
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that claimed variables to define a shape because Nishino's shape have been defined by 
the hand gestures including its position and such the use of variables to represent the 
hand gestures improves the efficiency of calculation during the interactive movement of 
the user and enhances the computer operations. 

Applicant argues that Nishino does not teach "the hand variables to define a 
shape". Examiner does not think that this language makes clear distinction with the 
teaching of Nishino. Nishino's hand shape and its position data used to create the 
object (page 55, column 1, lines 21-28) through the modification of shape descriptions 
clearly satisfy the claimed 'the hand variables to define a shape". 

Claims 8, 10-14, 22, and 23 are objected to as being dependent upon a rejected 
base claim, but would be allowable if rewritten in independent form including all of the 
limitations of the base claim and any intervening claims. 

Claims 2-3, 5-6, 7, and 20 are allowed. 

THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1 .136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory peripd, then the 
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shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1 .136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the mailing date of this final action. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Phu K. Nguyen whose telephone number is (571 ) 272 
7645. The examiner can normally be reached on M-F 8:00-4:30. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, bipin Shalwala can be reached on (571) 272 7681 . The fax phone number 
for the organization where this application or proceeding is assigned is 703-872-9306. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). 



Phu K. Nguyen 
May 24, 2005 
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